Weitere Korpora
- Afrikaans
- Albanian
- Amharic
-
Arabic
-
News
- 2005-2009 10K
- 2005-2009 30K
- 2005-2009 100K
- 2005-2009 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- Newscrawl
- Web
- Wikipedia
- Algeria
- Australia
- Bahrain
- COM
- Canada
- Egypt
- France
- Germany
- Iran
- Iraq
- Jordan
- Lebanon
- Mauritania
- Morocco
- Palestine
- Qatar
- Russia
- Saudi Arabia
- Sweden
- Syria
- Tunisia
- Turkey
- United Arab Emirates
- United Kingdom
-
News
- Aragonese
- Armenian
- Assamese
- Asturian
- Azerbaijani
- Balinese
- Banjar
- Bashkir
- Basque
- Bavarian
- Belarusian
- Bengali
- Bihari
- Bikol
- Bishnupriya
- Bosnian
- Breton
- Bulgarian
- Buriat
- Catalan
- Cebuano
- Central Bikol
- Central Kurdish
- Chechen
- Chinese
- Chuvash
- Corsican
- Croatian
-
Czech
-
News
- 2005 10K
- 2005 30K
- 2005-2007 10K
- 2005-2007 30K
- 2005-2007 100K
- 2005-2007 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2012 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 30K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
-
News
- Danish
- Dhivehi
- Dimli
- Dotyali
-
Dutch
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Wikipedia
- Aruba
- European Union
- Netherlands Antilles
- Suriname
-
News
- Eastern Mari
- Egyptian Arabic
- Emiliano-Romagnolo
-
English
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- American Samoa
- Anguilla
- Antigua and Barbuda
- Ascension
- Australia
- Bahamas, The
- Barbados
- Bermuda
- Botswana
- British Indian Ocean Territory
- Brunei
- Canada
- Dominica
- European Union
- Falkland Islands (Islas Malvinas)
- Fiji
- Gambia, The
- Germany
- Gibraltar
- Guadeloupe
- Guyana
- Ireland
- Kiribati
- Montserrat
- Namibia
- Nauru
- New Zealand
- Niue
- Philippines
- Puerto Rico
- Saint Kitts and Nevis
- Saint Lucia
- Saint Pierre and Miquelon
- Saint Vincent and the Grenadines
- Seychelles
- Singapore
- South Africa
- South Georgia & South Sandwich Islands
- Thailand
- Turks and Caicos Islands
- United Kingdom
- Zambia
- Zimbabwe
-
News
- Erzya
-
Esperanto
- Newscrawl
- Web
-
Wikipedia
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- European Union
- Estonian
- Extremaduran
- Faroese
- Fiji Hindi
- Finnish
-
French
-
News
- 2002-2005 10K
- 2002-2005 30K
- 2002-2005 100K
- 2002-2005 300K
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2008 10K
- 2005-2008 30K
- 2005-2008 100K
- 2005-2008 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Belgium
- Benin
- Burkina Faso
- Burundi
- Cameroon
- Canada
- Congo, (Congo & Kinshasa)
- Cote d'Ivoire (Ivory Coast)
- European Union
- France
- French Polynesia
- Gabon
- Guadeloupe
- Haiti
- Luxembourg
- Madagascar
- Mali
- Martinique
- Monaco
- New Caledonia
- Niger
- Reunion
- Rwanda
- Senegal
-
Switzerland
-
Web
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
-
Web
- Togo
- Tuvalu
-
News
- Friulian
- Galician
- Ganda
- Georgian
-
German
-
News
- 1995 10K
- 1995 30K
- 1995 100K
- 1995 300K
- 1996 10K
- 1996 30K
- 1996 100K
- 1996 300K
- 1997 10K
- 1997 30K
- 1997 100K
- 1997 300K
- 1998 10K
- 1998 30K
- 1998 100K
- 1998 300K
- 1999 10K
- 1999 30K
- 1999 100K
- 1999 300K
- 2000 10K
- 2000 30K
- 2000 100K
- 2000 300K
- 2001 10K
- 2001 30K
- 2001 100K
- 2001 300K
- 2002 10K
- 2002 30K
- 2002 100K
- 2002 300K
- 2003 10K
- 2003 30K
- 2003 100K
- 2003 300K
- 2004 10K
- 2004 30K
- 2004 100K
- 2004 300K
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2010 1M
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2012 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Austria
- Belgium
- COM
- European Union
- Germany
- Hungary
- Liechtenstein
- Luxembourg
- Namibia
- Poland
- Switzerland
-
News
- Gilaki
- Goan Konkani
- Guarani
- Gujarati
- Haitian
- Hausa
- Hebrew
- Hindi
- Hungarian
- Icelandic
- Ido
- Igbo
- Iloko
-
Indonesian
-
News
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Newscrawl-tufs5
- Newscrawl-tufs6
- Web
- Wikipedia
- Brunei
- COM
- India
- Indonesia
-
News
- Interlingua
- Interlingue
- Iranian Persian
- Irish
-
Italian
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2009 10K
- 2005-2009 30K
- 2005-2009 100K
- 2005-2009 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 100K
- 2012 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- San Marino
- Switzerland
-
News
-
Japanese
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2008 10K
- 2005-2008 30K
- 2005-2008 100K
- 2005-2008 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2020 10K
- 2020 30K
- 2020 100K
- 2021 10K
- 2023 10K
- 2023 30K
- 2023 100K
- Newscrawl
- Wikipedia
- COM
- Japan
-
News
- Javanese
- Kabiyè
- Kalaallisut
- Kannada
- Karachay-Balkar
- Kashubian
- Kazakh
- Kirghiz
- Komi
- Komi-Permyak
- Konkani
-
Korean
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- Newscrawl
- Web
- Wikipedia
- Korea, South
-
News
- Kurdish
- Kölsch
- Ladino
- Latin
- Latvian
- Lezghian
- Ligurian
- Limburgan
- Lithuanian
- Lombard
- Low German
- Lower Sorbian
- Lushai
- Luxembourgish
- Macedonian
- Madurese
- Maithili
- Malagasy
- Malay
- Malayalam
- Maltese
- Mandarin Chinese
- Manx
- Maori
- Marathi
- Mazanderani
- Middle High German (ca. 1050-1500)
- Min Nan Chinese
- Minangkabau
- Mingrelian
- Mirandese
-
Modern Greek
-
News
- 2007 10K
- 2007 30K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- Greece
-
News
- Mongolian
- Navajo
- Neapolitan
- Nepali
- Newari
- North Azerbaijani
- Northern Frisian
- Northern Sami
- Northern Uzbek
- Norwegian
- Norwegian Bokmål
- Norwegian Nynorsk
- Occitan
- Oriya
- Oromo
- Ossetian
- Pampanga
- Panjabi
- Papiamento
- Pedi
- Persian
- Pfaelzisch
- Piemontese
- Plateau Malagasy
-
Polish
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Wikipedia
- COM
- European Union
-
News
- Portuguese
- Pushto
- Quechua
- Romanian
- Romansh
-
Russian
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Azerbaijan
- Estonia
- European Union
- Georgia
- Kazakhstan
- Kyrgyzstan
- Latvia
- Lithuania
- Moldova
- SU
- Tajikistan
- Tuvalu
- Ukraine
- Uzbekistan
-
News
- Rusyn
- Sami
- Samogitian
- Sanskrit
- Sardinian
- Saterfriesisch
- Scots
- Scottish Gaelic
- Serbian
- Serbo-Croatian
- Shona
- Sicilian
- Silesian
- Sindhi
- Sinhala
- Slovak
- Slovenian
- Somali
- Southern Sotho
-
Spanish
-
News
- 2001-2002 10K
- 2001-2002 30K
- 2001-2002 100K
- 2001-2002 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Andorra
- Argentina
- Bolivia
- Colombia
- Costa Rica
- Cuba
- Dominican Republic
- Ecuador
- El Salvador
- European Union
- Guatemala
- Honduras
- Mexico
- Nicaragua
- Panama
- Paraguay
- Peru
- Puerto Rico
- United States
- Uruguay
- Venezuela
-
News
- Standard Estonian
- Standard Latvian
- Standard Malay
- Sundanese
- Swahili
- Swati
-
Swedish
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- Sweden
-
News
- Swiss German
- Tagalog
- Tajik
- Tamil
- Tatar
- Telugu
- Thai
- Tosk Albanian
- Tsonga
- Tswana
- Tulu
- Turkish
- Turkmen
- Tuvinian
- Udmurt
- Uighur
- Ukrainian
- Upper Sorbian
- Urdu
- Uzbek
- Venda
- Venetian
- Vietnamese
- Vlaams
- Volapük
- Võro
- Walloon
- Waray (Philippines)
- Welsh
- West Central Oromo
- Western Frisian
- Western Mari
- Western Panjabi
- Wu Chinese
- Xhosa
- Yakut
- Yiddish
- Yoruba
- Yue Chinese
- Zeeuws
- Zulu
Significance resp. Frequency resp. Number of right/left co-occurrences per Word vs. Rank
Slope from rank 10 to 1000 (sig)
| Slope |
|---|
| -0.5875 |
Slope from rank 10 to 1000 (freq)
| Slope |
|---|
| -0.5453 |
Slope from rank 10 to 1000 (left cooc)
| Slope |
|---|
| -0.6590 |
Slope from rank 10 to 1000 (right cooc)
| Slope |
|---|
| -0.6394 |
374 msec needed at 2018-03-29 01:44
5.1.11 Zipf's law for NN co-occurrences
Data Description
Usually Zipf’s law compares word frequency with word rank. Here we consider:
-
Significance vs. rank (drawn in red): Order all pairs of co-occurrences by significance. Plot the significance against the so defined rank.
-
Frequency vs. rank (green): As above, but use frequency instead of rank.
-
Number of right neighbors per word vs. rank (blue): Much like the original Zipf’s law, but use the number of right co-occurrences instead of its frequency.
-
Number of left neighbors per word vs. rank (pink): As above, but left instead of right neighbors.
Usage
The slope of the curves may give language parameters.
Especially the comparison of the last two lines might be important to see a possible difference between left and right neighbors for some languages.
Technical Details
Simplified Select statement
Significance vs. rank:
SELECT @pos:=(@pos+1), round(sig) FROM (SELECT @pos:=0) r, co_n WHERE w1_id>100 and w2_id>100 order by round(sig) desc;
Frequency vs. rank:
SELECT @pos:=(@pos+1), freq FROM (SELECT @pos:=0) r, co_n WHERE w1_id>100 and w2_id>100 order by freq desc;
Number of right neighbors per word vs. rank:
SELECT @pos:=(@pos+1), xx.cnt FROM (SELECT @pos:=0) r, (select count(*) as cnt from co_n WHERE w1_id>100 and w2_id>100 group by w1_id order by cnt desc) xx;
Number of right neighbors per word vs. rank:
SELECT @pos:=(@pos+1), xx.cnt FROM (SELECT @pos:=0) r, (select count(*) as cnt from co_n WHERE w1_id>100 and w2_id>100 group by w2_id order by cnt desc) xx;
Open questions
-
How to calculate the slope?
-
Why the green and red curve are parallel? Cp. 5.2.9.
See also
-
5.2.9 Zipf's law for Sentence co-occurrences